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EXECUTIVE  SUMMARY 


Requirement: 

In  1987,  the  U.S.  Army  Intelligence  Center  and  School 
(USAICS)  requested  that  the  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  (ARI)  investigate  a  number  of 
military  occupational  specialty  (MOS)  issues  related  to  the 
development  and  introduction  of  new  intelligence/electronic  war¬ 
fare  (lEW)  collection  and  processing  systems.  There  has  been  a 
need  to  develop  an  in-depth  taxonomy  that  can  be  used  to  iden¬ 
tify  and  determine  the  suitability  of  the  skills  and  abilities 
associated  with  military  intelligence  (MI)  MOS  and  lEW  systems. 


Procedure : 

One  method  for  identifying  skills  and  abilities  associated 
with  MOS  and  lEW  systems  is  based  on  the  Manual  of  Ability  Re¬ 
quirements  Scales  (MARS)  developed  by  E.  A.  Fleishman  and  his 
associates.  In  the  1984  version  of  MARS,  52  different  abilities 
were  defined.  To  identify  abilities  requirements  in  new  systems 
and  ability  capabilities  in  MOS,  a  flow  diagram  technique  was 
expanded  from  40  to  the  complete  set  of  52  abilities.  To  iden¬ 
tify  how  much  of  an  ability  is  needed,  an  existing  MARS  scalar 
measurement  method  was  adopted  and  extended.  These  two  instru¬ 
ments,  designated  as  the  "Job  Abilities  Assessment  System"  or 
JAAS,  were  applied  by  13  raters  to  MOS  96H  (Aerial  Intelligence 
Specialist)  and  MOS  97E  (Interrogator) .  A  JAAS  analysis  was  also 
made  of  the  abilities  demands  for  operations  and  launch  and  re¬ 
covery  of  the  Unmanned  Aerial  Vehicle  (UAV) . 


Findings : 


The  test  applications 
system  indicated  that  JAAS 
has  been  in  other  military 
in  both  the  identification 
specified. 


of  JAAS  to  two  MI  MOS  and  one  lEW 
can  be  used  in  the  MI  context  as  it 
job  and  task  settings.  Refinements 
and  the  scaling  parts  of  JAAS  were 
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utilization  of  Findings: 


The  revised  JAAS  technique  can  potentially  be  used  for 
determining  the  suitability  of  MI  MOS  to  meet  the  ability  and 
skill  requirements  associated  with  new  lEW  systems.  JAAS  can 
produce  ability  profiles  of  MOS,  identify  ability  and  skill 
requirements  associated  with  new  lEW  systems,  and  permit  an 
assessment  in  the  same  dimensions  of  the  match  between  MOS  and 
new  systems.  JAAS  data  are  also  useful  for  job  redesign,  devel 
opment  of  training  requirements,  and  establishment  of  new  selec 
tion  criteria. 
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Introduction 

In  earlier  work,  an  initial  model  of  a  military  intelligence 
(MI)  military  occupational  specialty  (MOS)  taxonomy  was  developed 
(Muckier,  Seven,  and  Akman,  1989) .  The  purpose  of  developing 
that  taxonomy  was  to  formulate  an  analytical  framework  which 
potentially  could  be  used  to  assess  the  capabilities  of  soldiers 
with  specific  MI  MOSs  as  well  as  to  determine  the  requirements 
for  skills  and  abilities  associated  with  intelligence/electronic 
warfare  (lEW)  systems. 

This  research  note  describes  a  technique  which  may  be  used  to 
convert  and  integrate  lEW  system  demands  into  the  MI  MOS 
taxonomy.  The  work  is  part  of  a  research  effort  focusing  on  the 
development  of  methodologies  and  techniques  which  can  be  used  to 
determine  the  suitability  of  MI  MOSs  to  meet  future  lEW  system 
demands . 

Background 

In  1987,  the  U.S.  Army  Intelligence  Center  and  School 
(USAICS)  requested  that  ARI  investigate  a  number  of  MOS  issues 
arising  from  the  development  and  introduction  of  new  lEW 
collection  and  processing  systems.  An  important  component  of 
this  research  is  the  development  of  a  taxonomy  of  the  parameters 
critical  for  evaluating  each  MI  MOS  and  career  management  field 
(CMF)  . 

In  previous  work,  an  initial  MI  MOS  taxonomy  was  developed 
which  included  descriptors  at  three  major  levels:  job-level 
variables,  MOS-level  variables,  and  CMF-level  variables.  These 
levels  assume  a  sequential  process  that  starts  with  micro-level 
evaluation  of  the  impact  of  job  changes  on  soldier's  tasks  and 
leads  to  macro-level  evaluation  where  the  impact  on  MOS 
aggregates  and  CMF  can  be  measured. 

Of  the  many  dimensions  included  in  the  initial  taxonomy, 
those  concerning  abilities  and  skills  map  most  directly  to  the 
issues  associated  with  the  psychological  descriptors  which  are 
critical  elements  in  establishing  the  suitability  of  existing 
MOSs  to  meet  future  lEW  system  demands.  These  dimensions,  of  the 
many  included  in  the  initial  taxonomy,  also  pose  more  difficulty 
with  respect  to  their  application  and  measurement  in  manpower, 
personnel,  and  training  (MPT)  analysis. 

Objective 

The  objective  of  the  current  research  is  to  refine  a  method 
to  determine  the  abilities  and  skills  represented  by  MOSs  and 
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potentially  required  for  the  operation  and  maintenance  of  lEW 
systems.  This  method  for  identifying  and  scaling  abilities  and 
skills,  which  is  based  on  work  by  E.A.  Fleishman,  is  here  called 
the  Job  Abilities  Assessment  System  (JAAS) . 

JAAS  in  its  present  form  is  a  research  product  requiring 
testing,  evaluation,  and  refinement  before  operational  use  can  be 
recommended.  In  the  present  instance,  the  focus  is  on  its  use  in 
determining  the  ability  and  skill  requirements  associated  with 
lEW  systems.  Its  development  and  application,  at  this  stage,  is 
part  of  an  evolutionary  process. 

The  present  formulation  of  JAAS  was  used  experimentally  to 
assess  its  effectiveness.  Test  applications  were  made  to 
specific  lEW  systems  as  well  as  to  MI  MOSs  of  the  96  CMF.  At 
each  stage  of  its  application,  the  results  were  evaluated  to 
determine  the  reliability  of  its  use  in  identifying  and  scaling 
abilities  and  skills. 

Initial  applications  were  performed  by  project  team  personnel 
representing  a  variety  of  different  backgrounds  including 
research  psychology,  MPT  analysis,  and  Army  personnel  planning. 
The  results  of  these  limited  applications  are  presented  in  a 
subsequent  chapter,  and  the  results  were  used  to  refine  JAAS. 

The  modified  JAAS  will  then  be  made  available  to  subject 
matter  experts  (SME)  representing  MOSs  in  the  96  CMF  and  lEW 
system  development.  The  objective  of  these  test  applications,  in 
addition  to  refining  and  validating  JAAS,  is  to  create  catalogues 
of  the  ability  and  skill  attributes  associated  with  the  96  CMF 
MOSs,  including: 

96B  Intelligence  Analyst 

96D  Imageiry  Analyst 

96H  Aerial  Intelligence  Specialist 

96R  Ground  Surveillance  Systems  Operator 

97B  Counterintelligence  Agent 

97E  Interrogator 

97G  Counter-Signals  Intelligence  Specialist. 

In  addition,  the  ability  and  skill  requirements  associated  with 
four  emerging  lEW  systems  will  also  be  catalogued.  The  following 
lEW  system  requirements  will  be  identified: 

Joint  Surveillance/Target  Acquisition  Radar  (JSTARS) 

Unmanned  Aerial  Vehicle  (UAV) 

Imagery  Processing  and  Dissemination  System  (IPDS) 
Commander's  Tactical  Terminal  (CTT) . 

The  results  of  the  JAAS  application  will  set  the  stage  for 
additional  research  aimed  at  developing  methods  for  determining 
whether  the  MOS  and  lEW  abilities  profiles  are  compatible  and,  if 
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not,  indicating  possible  approaches  for  aligning  capabilities  and 
requirements  for  more  effective  man-machine  systems. 

In  sum,  under  this  current  effort,  JAAS  will  be  the  focus  of 
test  applications,  analysis,  and  refinement  in  order  to  determine 
whether  its  decision  flow  diagrams  and  scalar  techniques  can  be 
used  to  assess  the  suitability  of  MI  MOS  capabilities  in  meeting 
lEW  system  demands. 
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JAAS  Method  for  Assessment  of  MOS  Capabilities 
and  lEW  System  Requirements 

Generating  New  Systems  MOS  Requirements 

As  new  lEW  systems  evolve,  there  is  a  corresponding  need  to 
establish  the  MPT  consequences  of  the  new  tasks  that  the  lEW 
systems  will  bring  to  system  operators  and  maintainers.  New 
technology  does  not  necessarily  demand  new  tasks.  There  may  be 
modifications  of  old  tasks,  slight  and  insignificant  shifts  in 
task,  or  no  apparent  change  in  personnel  task  demands.  On  the 
other  hand,  the  tasks  may  change  so  radically  that  previous  MOS 
designations  may  no  longer  be  appropriate. 

Methodologically,  what  is  needed  is  to  predict  the  task  and 
job  demands  of  the  new  lEW  system  so  that  these  demands  can  be 
compared  with  the  characteristics  of  the  present  soldier  force. 

To  do  that,  one  immediate  need  is  to  specify  the  dimensions  upon 
which  the  comparisons  will  be  made  and  the  appropriate 
information  that  must  be  derived  to  make  comparisons. 

In  a  previous  research  note  (Muckier,  Seven,  and  Akman, 

1989)  ,  a  taxonomy  was  developed  at  several  levels  by  which 
parameters  were  defined  for  comparisons  of  new  systems  against 
current  work  force  capability.  Of  relevance  here  is  the  initial 
impact  of  the  new  systems  on  the  soldier's  job;  these  were  termed 
"Job-Level  Variables"  and  they  are  shown  in  Table  1.  In  short, 
these  are  defined  as  the  critical  parameters.  These  ha'^e  to  be 
defined  and  measured  if  comparisons  are  to  be  made  between  new 
and  present  system  job  and  task  demands. 

Data  on  these  dimensions  vary  in  terms  of  their  availability 
and  the  ease  with  which  they  can  be  extracted  from  a  considerable 
variety  of  information  sources.  In  some  parameters,  the  way  the 
dimension  is  measured  is  well-defined  (e.g.,  1.A.2  Physical 
demands)  while  in  others  (e.g.,  1.B.5  Work  attitudes)  both  the 
parameters  and  its  measurement  implementation  are  not  well  known. 
Thus,  a  major  task  at  this  point  is  to  continue  to  explore  in 
detail  how  the  parameters  can  be  measured,  how  pertinent  data  can 
be  derived,  and  how  those  data  can  be  used. 

Of  particular  interest  at  this  time  is  category  1.B.4 
(Abilities  and  Skills) .  In  short,  there  will  be  concern  about 
the  comparison  of  abilities  and  skills  of  the  existing  personnel 
supply  and  the  ability  and  skill  requirements  of  the  new  lEW 
systems.  In  what  follows,  the  JAAS  method,  which  can  be  used  to 
extract  a  major  part  of  the  abilities  and  skills,  is  described. 

Identifying  Ability  and  Skill  Requirements  in  lEW  Systems 

The  first  step  that  must  be  taken  is  to  describe  the  set  of 
abilities  and  skills  that  underlie  performance  in  MI  MOSs,  as 
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Table  1 


Comparison  Variables  For  New  lEW  Systems  at  the  Job  Level 


I.  JOB-LEVEL  VARIABLES 

A.  Critical  Job  Variables 

1 .  Workload  demands 

2 .  Physical  demands 

3.  Skill  requirements 

4 .  Organizational  requirements 

5 .  Performance  requirements 

B.  Soldier  Characteristics 

1.  Educational  Requirements 

a.  Educational  level 

b.  Reading  level 

2.  Mental  category 

3.  Physical  abilities  (PULHES) 

4.  Abilities  and  skills 

5 .  Work  attitudes 

a.  Work  orientation 

b.  Dependability 

6.  Special  requirements 
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well  as  the  old  and  new  lEW  systems.  Abilities  refer  to  the 
attributes  of  the  individual  performing  .he  task.  These 
attributes  range  from  physical  capabilities  such  as  vision, 
hearing,  and  strength,  to  intellectual  capabilities  like 
reasoning  and  logical  thought  capacity.  Abilities  are  relatively 
stable,  enduring  traits.  Skills  refer  to  the  individual's  level 
of  proficiency  on  a  specific  task  (Fleishman  and  Quaintance, 

1984)  , 


Based  on  almost  a  century  of  experimentation  and  theory 
construction,  there  are  several  taxonomies  that  could  describe 
abilities  anf  skills  with  well-defined  and  empirically  based 
dimensions.  The  most  useful,  however,  appears  to  be  the  Manual 
for  Abilities  Requirements  Scales  (MARS)  developed  by  Fleishman 
and  his  associates  (Fleishman  and  Quaintance,  1984,  Appendix  B)  . 
MARS  has  52  defined  dimensions,  all  measurable,  which  are  shown 
in  Table  2 . 

This  taxonomy  is  suggested  for  a  number  of  reasons.  First, 
it  has  been  widely  tested  and  used  in  a  wide  variety  of  civilian 
and  military  jobs  and  tasks.  Second,  it  has  been  the  most 
extensively  used  taxonomy  for  a  considerable  number  of  military 
jobs.  Third,  analytic  methods  are  available  to  extract 
information  about  each  of  these  abilities  from  narrative 
descriptions  of  the  tasks  for  new  systems;  empirical  measurement 
is  not  essential.  Fourth,  the  methods  associated  with  this 
technique  have  been  shown  to  give  high  reliability  for  the 
abilities  and  skills  that  may  be  needed  for  new  lEW  system  tasks. 
The  information  so  derived  can  be  compared  with  the  ability  and 
skill  capabilities  of  the  existing  and  appropriate  MOS  soldiers 
who  might  be  called  upon  to  perform  the  new  lEW  system  jobs  and 
tasks. 

When  applied,  the  method  brings  forth  two  kinds  of 
information  —  whether  or  not  the  ability  (as  listed  in  Table  2) 
is  required  for  the  performance  and  how  much  of  the  ability  is 
required.  The  first  step  identifies  the  required  abilities  and 
the  second  step  identifies  the  skill  levels  required  for  those 
abilities  needed  for  the  operational  task. 

Many  experimental  studies  have  demonstrated  the  need  for 
some  subset  of  the  abilities  listed  in  Table  2  to  perform  human 
operational  tasks.  They  may  be  seen  as  abilities  the  human  must 
possess  to  some  degree  or  else  he  or  she  cannot  perform 
satisfactc  -ily.  On  the  other  hand,  many  h\iman  jobs  can  be  done 
quite  well  without  many  of  the  abilities.  For  example,  the  need 
for  NIGHT  VISION  (#23)  is  obviously  restricted  to  those 
situations  where  ambient  and  task  lighting  is  low.  What  one 
attempts  to  do  for  each  job  or  task  is  to  derive  a  profile  of 
those  abilities  required  for  the  job,  eliminating  those  that 
either  are  not  required  or  have  very  low  importance.  The  result 
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Table  2 


M3VRS  Abilities  and  Skills  Dimensions* 


1. 

ORAL  COMPREHENSION 

27. 

GLARE  SENSITIVITY 

2. 

WRITTEN  COMPREHENSION 

28. 

GENERAL  HEARING 

3. 

ORAL  EXPRESSION 

29. 

AUDITORY  ATTENTION 

4. 

WRITTEN  EXPRESSION 

30. 

SOUND  LOCALIZATION 

5. 

MEMORIZATION 

31. 

SPEECH  HEARING 

6. 

PROBLEM  SENSITIVITY 

32. 

SPEECH  CLARITY 

7. 

ORIGINALITY 

33. 

VISUALIZATION 

8. 

INDUCTIVE  REASONING 

34. 

STATIC  STRENGTH 

o  _ 

CATEGORY  FLEXIBILITY 

35. 

EXPLOSIVE  STRENGTH 

10. 

DEDUCTIVE  REASONING 

36. 

DYNAMIC  ST^.r:NGTH 

11. 

INFORMATION  ORDERING 

37. 

TRUNK  STRENGTH 

12  . 

MATHEMATICAL  REASONING 

38. 

STAMINA 

13. 

NUMBER  FACILITY 

39. 

EXTENT  FLEXIBILITY 

14. 

FLUENCY  OF  IDEAS 

40. 

DYNAMIC  FLEXIBILITY 

15. 

TIME  SHARING 

41. 

GROSS  BODY  EQUILIBRIUM 

16. 

FLEXIBILITY  OF  CLOSURE 

42. 

SPEED  OF  LIMB  MOVEMENT 

17. 

SPEED  OF  CLOSURE 

43. 

GROSS  BODY  COORDINATION 

18. 

SELECTIVE  ATTENTION 

44. 

MULTI-LIMB  COORDINATION 

19. 

PERCEPTUAL  SPEED  AND  ACCURACY 

45. 

WRIST  FINGER  SPEED 

20. 

SPATIAL  ORIENTATION 

46. 

FINGER  DEXTERITY 

21. 

NEAR  VISION 

47. 

MANUAL  DEXTERITY 

22. 

FAR  VISION 

48. 

ARM  HAND  STEADINESS 

23. 

NIGHT  VISION 

49. 

CONTROL  PRECISION 

24. 

VISUAL  COLOR  DISCRIMINATION 

50. 

RATE  CONTROL 

25. 

PERIPHERAL  VISION 

51. 

REACTION  TIME 

26. 

DEPTH  PERCEPTION 

52. 

CHOICE  REACTION  TIME 

♦Source:  Fleishman  and  Quaintance  (1984) ,  Appendix  B. 
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is  an  "abilities  profile"  which  is  a  major  definition  of  the  job 
in  terms  of  the  requirements  for  the  people  who  are  going  to 
perform  the  job. 

A  Flow  Method 

JAAS  is  a  decision  aid  method  t^at  has  been  developed  so  that 
an  abilities  profile  can  be  derived  for  any  human  job  or  task 
that  can  be  described  in  a  narrative  summary.  This  decision  aid 
was  developed  by  Mallamad,  Levine,  and  Fleishman  (1980)  for  40  of 
the  abilities  shown  in  Table  2. 

The  basic  form  of  this  method  is  shown  in  Figure  1  which 
illustrates  the  flow  diagrams  and  the  questions  asked  to  identify 
the  presence  or  absence  of  the  first  two  abilities  in  Table  2: 
ORAL  COMPREHENSION  and  WRITTEN  COMPREHENSION.  The  analyst  is 
taken  through  a  series  of  questions  which  by  a  simple  "yes"  or 
"no"  can  generate  a  profile  of  all  abilities  needed  for  the  job 
or  task. 

In  the  present  version  here,  the  decision  flow  method  has  been 
expanded  from  the  40  dimensions  in  Mallamad,  et.  al.,  to  the  full 
52  shown  in  Table  2;  this  expansion  has  meant  adding  dimensions 
21  (NEAR  VISION)  through  32  (SPEECH  CLARITY) .  Choice  questions 
have  been  added  for  those  12  dimensions. 

The  decision  flow  diagrams  comprise  JAAS,  Part  1.  Appendix  A 
provides  the  complete  package  containing  decision  flow  diagrams 
for  all  52  abilities  and  skills.  It  is  a  manual  "paper  and 
pencil"  decision  aid,  although  it  is  possible  to  develop  a 
computer-based  system. 

A  set  of  instructions  has  been  developed  incorporating  a 
previously  developed  "Driving"  example  as  a  learning  and  warm-up 
task  for  individuals  using  the  method.  In  actual  fact,  since 
this  method  has  been  in  use  for  almost  13  years,  several  sample 
tasks  are  available  including  electronic  troubleshooting  and 
other,  more  complex,  examples  for  learning  how  to  use  the  system. 
Past  experience  with  the  method,  however,  has  indicated  that  one 
simple  example  is  usually  quite  sufficient  for  analysts  and 
subject  matter  experts. 

To  be  used  for  a  given  job  or  task,  the  method  requires  that  a 
narrative  job  or  task  description  be  written.  The  analyst  or 
subject  matter  expert  then  uses  the  description  as  the  basis  from 
which  to  answer  the  kinds  of  questions  illustrated  in  Figure  1. 

In  comparisons  of  old,  current,  or  projected  technological 
systems,  narrative  job  or  task  descriptions  would  have  to  be 
written  for  each,  and  the  analysis  completed  for  each,  for 
profile  differences  in  abilities  to  become  apparent. 
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Figure  1.  An  Illustrative  exzimple  of  using  the  Job  Abilities 
Assessment  System  (JAAS)  to  derive  required  job  or 
task  abilities. 
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Clustering  the  Abilities 


In  using  the  results  of  this  kind  of  analysis,  many 
questions  will  be  asked  about  the  specific  abilities  shown  in 
Table  2.  But  questions  may  also  be  asked  at  different  conceptual 
levels  and  the  abilities  can  be  clustered  (if  they  are  present  in 
the  job  or  task)  to  answer  those  questions. 

For  example,  there  could  well  be  questions  about  the 
strength  and  stamina  requirements  for  the  new  set  of  lEW  tasks. 
Five  of  the  abilities  in  Table  2  relate  to  strength  and  stamina: 

34.  Static  strength 

35.  Explosive  strength 

36.  Dynamic  strength 

37.  Trunk  strength 

38.  Stamina. 

These  five  could  be  examined  as  a  cluster,  and  they  would  be 
relevant  to  questions  about  the  physical  demands  of  the  new  lEW 
jobs  (cf..  Table  1,  1.A.2). 

Or,  in  a  related  area  there  could  be  concern  about 
flexibility  and  physical  coordination  requirements.  Five 
abilities  cluster  in  that  area; 

39.  Extent  flexibility 

40.  Dynamic  flexibility 

41.  Gross  body  equilibrium 

43.  Gross  body  coordination 

45.  Multi-limb  coordination. 

Many  jobs  continue  to  demand  strength  and  stamina  and  flexibility 
and  coordination  (including  current  and  projected  lEW  system  jobs 
and  tasks) .  These  factors  should  not  be  ignored  if  they  are 
present  since  they  can  markedly  affect  job  performance  levels. 

Perhaps  one  of  the  most  important  and  interesting  of  the 
possible  clusters  that  could  be  developed  from  Table  1  concerns 
"cognitive  abilities".  Although  there  would  surely  be  some 
disagreement  among  cognitive  experts,  the  first  21  abilities  in 
the  list  in  Table  1  might  be  termed  "cognitive  abilities"  with 
the  possible  addition  of  #32  (SPEECH  CLARITY) . 

In  previous  work  on  the  96  CMF,  previous  analyses  had 
suggested  that  the  following  cognitive  abilities  may  be  critical 
in  military  intelligence  and  lEW  tasks: 

Verbal  ability 
Reasoning  ability 
Arithmetic  reasoning 
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These  abilities  may  be  translated  into  the  following  equivalences 
from  the  list  of  cognitive  abilities  in  Table  1; 


Verbal  ability 
Reasoning  ability 

-  Memory 

-  Arithmetic  reasoning 


#3  ORAL  EXPRESSION 
#32  SPEECH  CLARITY 

#8  INDUCTIVE  REASONING 
#10  DEDUCTIVE  REASONING 

#5  MEMORIZATION 

#12  MATHEMATICAL  REASONING 
#13  NUMBER  FACILITY 


Questions  that  are  asked  of  abilities  at  a  higher  conceptual 
level  may  be  answered  on  the  basis  of  estimates  from  lower  level 
and  more  precise  abilities. 

Further  work  is  underway  to  define  various  clusters  of  the 
52  abilities  listed  in  Table  1.  One  purpose  is  to  demonstrate 
what  kinds  of  questions  can  be  asked  at  higher  conceptual  levels 
beyond  the  specificity  demanded  by  MARS. 

Scaling  the  Abilities 

Once  the  abilities  needed  in  performing  a  specific  job  or 
task  have  been  selected  using  JAAS,  Part  1,  comparisons  can  be 
made  between  jobs  or  tasks  simply  on  the  basis  of  which  abilities 
are  needed  and  which  are  not.  However,  not  all  jobs  or  tasks 
that  require  a  given  ability  demand  the  same  amount  of  that 
ability.  Some  tasks  may  need  only  a  minimum  amount  of  a  given 
ability,  while  other  tasks  may  require  a  very  high  degree  of  that 
same  ability.  Also,  a  task  may  need  only  a  little  of  one 
ability,  a  great  deal  of  another  ability,  and  a  medium  amount  of 
yet  a  third  ability.  Knowing  not  only  if  an  ability  is  needed 
for  a  specific  job  or  task  but  also  how  much  of  that  ability  is 
needed  makes  more  detailed  comparisons  between  jobs  and  tasks 
possible. 

To  facilitate  judgements  about  how  much  of  a  given  ability 
is  needed,  a  second  instrument  has  been  developed.  That 
instrument,  Job  Abilities  Assessment  System,  Part  2,  contained  in 
Appendix  B,  presents  each  ability,  together  with  its  definition, 
on  a  page  above  a  seven-point  scale.  For  each  ability  judged 
necessary  to  the  job  or  task  being  rated,  a  rater  is  asked  to 
decide  how  much  of  the  ability  in  question  is  needed  in  doing  the 
task,  with  "1"  indicating  a  minimum  level  of  that  ability,  "7" 
indicating  a  very  high  level  of  that  ability,  and  intermediate 
points  in  the  scale  indicating  intermediate  levels. 

To  assist  the  rater  in  making  the  judgement,  three  sample 
tasks  are  shown  to  the  right  of  the  scale,  positioned  according 
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to  the  average  ratings  given  for  that  task  or  that  ability  by  a 
large  number  of  previous  raters.  As  an  example,  see  Figure  2. 

The  ability  in  question  is  CONTROL  PRECISION.  The  definition 
appears  together  with  the  number  ”49''  and  the  name  of  the  ability 
at  the  top  of  the  page.  Below  that  is  the  seven-point  scale.  To 
the  right  of  the  scale,  three  sample  tasks  are  shown  and  their 
ratings  indicated. 

"Drill  a  tooth"  is  shown  opposite  the  "6";  the  average 
rating  given  this  task  in  this  skill  by  previous  raters  was  5.96, 
indicating  that  a  great  deal  of  CONTROL  PRECISION  is  needed  to 
drill  a  tooth.  The  second  task  shown,  "Manipulate  farm  tractor 
controls",  was  judged  to  need  an  intermediate  amount  of  CONTROL 
PRECISION,  not  as  much  as  is  needed  in  drilling  teeth  but  more 
than  needed  for  the  third  task,  "Throw  a  light  switch".  At  1.24, 
throwing  a  light  switch  was  judged  to  take  a  minimum  amount  of 
that  skill.  In  other  words,  CONTROL  PRECISION  is  one  of  the 
abilities  needed  in  throwing  a  light  switch,  but  the  task  demands 
very  little  CONTROL  PRECISION. 

The  tasks  shown  as  examples  for  the  various  abilities 
require  abilities  and  skills  other  than  the  one  they  illustrate. 
For  example,  drilling  a  tooth  takes  abilities  and  skills  in 
addition  to  CONTROL  PRECISION.  The  types  and  amounts  of  other 
abilities  are  irrelevant  to  the  placement  of  "Drill  a  tooth"  on 
the  CONTROL  PRECISION  scale.  Drilling  a  tooth  also  has  knowledge 
requirements,  but  they,  too,  are  irrelevant  here.  The  amount  of 
CONTROL  PRECISION  involved  in  the  task  of  drilling  a  tooth 
determines  its  placement  in  this  case. 

Once  the  abilities  have  been  selected  for  a  given  job  or 
task  (JAAS,  Part  1) ,  each  of  the  chosen  abilities  are  rated  in 
turn  in  JAAS,  Part  2.  Then  from  the  results  of  the  sequence  of 
judgements,  a  profile  of  a  job  or  task  can  be  constructed, 
showing  not  just  which  abilities  are  involved  in  a  specific  job 
or  task  but  also  how  much  of  each  of  the  required  abilities  is 
needed. 

Using  JAAS  Results 

Profile  comparisons.  Mention  has  already  been  made  several  times 
of  comparisons  between  various  profiles.  One  example  is  the  set 
of  abilities  profiles  associated  with  the  current  MOS-qualified 
individuals  and  the  abilities  requirements  that  they  may  be  asked 
for  in  new  systems.  Another  example  is  a  comparison  of  profiles 
across  MOS  categories  as  a  partial  test  of  the  appropriateness  of 
a  CMF. 

These  profiles  are  also  useful  for  corrective  action  in  new 
system  design.  If,  for  example,  the  abilities  exceed  both  the 
capabilities  of  the  currently  available  manpower  and  personnel 
pool  and  the  probable  characteristics  of  the  people  who  will  be 
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Figure  2.  An  exeunple  of  the  Job  Abilities  Assessment  System 
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available  to  field  the  system,  then  corrections  must  be  made  in 
job  and  task  design.  This  type  of  analysis  has  been  used  in  the 
past  with  such  systems  as  the  Howitzer  Improvement  Program  (HIP) 
and  a  number  of  the  new  air  defense  systems. 

Selection  criteria.  By  their  particular  nature,  the  abilities 
listed  in  Table  1  point  directly  to  selection  criteria  and  the 
appropriate  selection  tests  that  should  be  made  to  pick  people 
who  will  operate  and  maintain  future  systems.  At  the  moment, 
analysis  suggests  that  ARITHMETIC  REASONING  is  the  principal 
ability  that  soldiers  selected  for  military  intelligence 
positions  share.  Profiles  of  the  separate  MI  MOSs  to  be 
generated  in  this  program  may  indicate  that  they  share  other 
abilities  as  well. 

But  the  system  profiles  derived  by  JAAS  can  provide  direct 
criteria  for  selection  dimensions  and  the  application  of  the 
results  of  Part  2  can  also  suggest  the  differential  importance  of 
each  ability  in  all  the  abilities  needed  by  the  soldier.  To  be 
noted  in  passing  is  that  every  ability  in  the  list  of  52  has  a 
number  of  selection  tests  that  could  be  used  to  measure  it  in  the 
selection  context. 

Training  requirements.  In  developing  training  system 
requirements  for  new  systems  and  all  MOS  categories,  a  number  of 
kinds  of  training  have  to  be  specified.  One  of  those  is  the 
fundamental  abilities  for  which  training  should  be  provided.  The 
JAAS-derived  ability  profile  gives  a  direct  indication  of  the 
areas  in  which  training  could  well  be  considered  as  a  foundation 
for  eventual  exact  training  in  specific  job  tasks  and  skills. 

If,  for  example,  ARITHMETIC  REASONING  is  a  foundation  ability  for 
the  96  CMF,  it  can  very  well  be  trained  in  a  variety  of 
appropriate  contexts  for  eventual  transfer  of  training  to 
particular  task  performance  (cf.  Fleishman  and  Mumford,  1989) . 
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Test  Applications 


Applying  JIA8  to  mi  moss 

Seunple  MOSs.  To  test  the  application  of  JAAS  to  sample  MOSs  from 
the  96  career  management  field,  two  MOSs  were  selected: 

•  Interrogator  (MOS  97E) 

•  Aerial  Intelligence  Specialist  (MOS  96H) 

Summary  job  descriptions  for  these  MOSs  are  given  in 
Appendix  C.  Because  of  the  major  operational  differences  between 
these  two  MOSs,  using  them  should  provide  a  useful  test  of 
whether  or  not  distinctive  and  discriminable  ability  profiles  can 
be  obtained  with  military  intelligence  jobs  from  the 
implementation  of  the  JAAS  methodology.  If  different  profiles 
are  produced  for  these  two  MOSs,  it  will  establish  the 
feasibility  of  applying  JAAS  to  clarify  the  abilities  and  skills 
requirements  of  the  MI  MOSs.  If  non-distinctive  profiles  are 
obtained,  applying  JAAS  would  seem  fruitless. 

Procedure.  Thirteen  (13)  raters  were  given  the  job  descriptions 
for  97E  and  96H  as  shown  in  Appendix  C  and  the  JAAS  Part  1 
(Appendix  A)  and  JAAS  Part  2  (Appendix  B)  manuals.  Their 
analysis  task  was  to  apply  both  parts  of  JAAS  to  the  two  MOS  job 
descriptions.  The  raters  were  given  brief  descriptions  of  the 
JAAS  technique  and  the  analysis  task.  They  were  then  allowed  to 
take  the  test  materials  away  and  work  on  the  analysis 
individually. 

It  was  possible  to  have  access  to  raters  with  a  variety  of 
military  and  technical  backgrounds.  Four  of  the  raters  were 
active  duty  Army  personnel,  three  were  Army  Research  Institute 
(ARI)  personnel,  and  six  were  contractor  personnel.  Four  of  the 
contractor  personnel  had  military  service  backgrounds  ranging 
from  2  to  20  years  in  length.  All  of  the  contractor  personnel 
had  several  years  familiarity  with  military  organizations  and 
procedures.  Thus,  none  of  the  raters  was  naive  with  respect  to 
the  Army.  Two  of  the  raters  were  subject  matter  experts  (SMEs) 
with  respect  to  military  intelligence.  Six  of  the  other  raters 
had  considerable  familiarity  with  MI  either  in  terms  of  training 
requirements  or  research  and  development  projects.  The  other 
five  raters  had  no  MI  background.  Seven  of  the  raters  had 
extensive  training  in  psychology,  four  holding  Ph.D.s  in  the 
field.  The  other  six  raters  were  not  trained  in  psychology.  Two 
of  the  raters  had  previous  experience  with  the  predecessor  of  the 
JAAS  procedures.  Eigh-*-  of  the  raters  were  male  and  five,  female. 
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Results.  The  primary  test  results  are  shown  in  the  following 
series  of  Tables  and  Figures: 

1.  Table  3  shows  the  entire  raw  data  set  for  the  JAAS 
analysis  for  MOS  96H  and  for  each  of  the  13  raters.  The  cell 
entries  under  the  raters  give  the  JAAS  Part  2  scale  value  the 
rater  generated;  if  the  cell  is  empty,  the  rater  judged  that  the 
ability  was  not  needed  for  the  job.  In  addition,  four  summary 
statistics  are  given:  the  number  of  raters  who  judged  that  "yes" 
the  ability  was  needed,  means  of  the  scalar  values,  standard 
deviations  and  variance. 

2.  Table  4  looks  at  the  abilities  and  skills  for  MOS  96H 
ordered  in  terms  of  the  number  of  raters  who  judged  the  ability 
to  be  required  (or  not  required)  for  the  task.  So,  for  example, 
all  13  raters  judged  FAR  VISION  as  required,  and  only  one  so 
rated  DYNAMIC  STRENGTH.  It  can  be  seen  that  all  13  raters  found 
17  of  the  52  abilities  necessary  for  the  MOS  96H  job. 

3 .  Table  5  presents  the  entire  raw  data  set  for  the  JAAS 
analysis  of  MOS  97E.  Again,  the  values  within  the  cells  are  the 
rater's  judgements  for  that  ability.  Where  a  cell  is  empty,  the 
rater  judged  the  ability  was  not  needed. 

4.  Table  6  shows  the  JAAS  analysis  of  MOS  97E  abilities  and 
skills  as  ordered  by  raters'  number  of  "yes"  responses  and  the 
JAAS  Part  2  means.  It  can  be  seen  in  Table  6  that  all  13  raters 
found  that  12  out  of  52  abilities  were  needed  for  the  performance 
of  this  job.  It  can  also  be  seen  that  the  bottom  12  abilities 
were  judged  not  required  for  job  performance. 

5.  Figure  3  presents  a  general  graphical  comparison  of  the 
^wo  test  MOSs  in  profile  form  and  clustered  in  the  eight 
categories  described  in  a  preceding  chapter.  It  may  be  seen  that 

(1)  the  individual  MOSs  generate  distinct  abilities  profiles  and 

(2)  the  profiles  differ  considerably  one  from  the  other.  On  the 
other  hand,  the  two  MOSs  also  share  some  strong  common 
characteristics:  communication,  conceptual,  and  reasoning 
skills . 


6.  More  detailed  quantitative  data  are  provided  in  Table  7. 
Abilities  by  clusters  are  shown;  for  each  ability  the  number  of 
raters  requiring  that  ability  for  the  job  and  the  mean  value  of 
the  job  are  given.  An  important  part  of  these  data  is  the 
opportunity  to  examine  the  relative  homogeneity  of  the  various 
clusters.  For  example,  it  can  be  seen  in  Table  7  that  the 
abilities  that  constitute  communication  skills  are  all  important 
both  for  MOS  96H  and  MOS  97E. 

7.  Data  from  Table  7  are  presented  graphically  in  Figure  4. 
For  both  MOS  96H  and  MOS  97E,  the  number  of  raters  judging  an 
ability  to  be  required  is  shown  for  all  52  abilities,  divided 
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JAAS  Analysis  -  MOS  96H  Abilities  and  Skills  (continued) 
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Table  4 


JAAS  Analysis  -  MOS  96H  Abilities  and  Skills — Ordered  by  JAAS 
Part  1  "Yes"  Responses  and  Part  2  Means 


22  FAR  VISION 


6IPR0BLEM  SENSITIVITY 


lOlDEDUCTIVE  REASONING 


19IPERCEPTUAL  SPO  &  ACCURACY 


SlMEHORIZATION 


18  SELECTIVE  ATTENTION 


24  VISUAL  COLOR  DISCRIMINATION 


49IC0NTR0L  PRECISION 


13|NUMBER  FACILITY 


46  FINGER  DEXTERITY 


31  SPEECH  HEARING 


11  INFORMATION  ORDERING 


21INEAR  VISION 


ORAL  COMPREHENSION 


27  GLARE  SENSITIVITY 


471MANUAL  DEXTERITY 


44  MULTI -LIMB  COORDINATION 


33IVISUALIZATION 


52ICHOICE  REACTION 


25IPERIPHERAL  VISION 


39  EXTENT  FLEXIBILITY 


8  INDUCTIVE  REASONING 


12IHATHEMATICAL  REASONING 


26  DEPTH  PERCEPTION 


WRITTEN  EXPRESSION 


14  FLUENCY  OF  IDEAS 


9  CATEGORY  FLEXIBILITY 


34ISTATIC  STRENGTH 


481  ARM  HAND  STEADINESS 


28  GENERAL  HEARING 


45  WRIST  FINGER  SPEED 


29IAUOITORY  ATTENTION 


171  SPEED  OF  CLOSURE 


7  ORIGINALITY 


50IRATE  CONTROL 


30 1  SOUND  LOCALIZATION 


43IGROSS  BOOT  COORDINATION 


41  GROSS  8XY  EQUILIBRIUM 


42  SPEED  OF  LIMB  MOVEMENT 


51IREACTION  TIME 


40IDYNAMIC  FLEXIBILITY 


38ISTAMINA 


YES  MEAN  1 


13 


SO  I  VAR 


___  15^ 

TIME  SHARING  j 

131 

5.5 

16jFLEXIBILITY  OF  CLOSURE  | 

13 

5.5 

WRITTEN  COMPREHENSION 

13i 

5.3 

3(ORAL  EXPRESSION  1 

13 

5.2 

32 

SPEECH  CLARITY 

13 

5.2 

23 

NIGHT  VISION 

13 

5.1 

20ISPATIAL  ORIENTATION  1 

13! 

5.1 

mt 


OBI 


Esn 


1.21  1.4 


1.2l  1.4 


0.91 


1.41  1.9 


0.8 


35 

[EXPLOSIVE  STRENGTH 

- T 

!  s.oi 

371TRUNK  STRENGTH 

1 

1  s.oi 

m 


1.0 

1  1.1 

1.0 

1.1 

0.8 

IKS! 

0.9 

1 _ M 

Si 


36IOYNAMIC  STRENGTH 


JAAS  Analysis  -  MOS  97E  TVbllities  and  Skills 
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JAAS  Analysis  -  MOS  97E  Abilities  and  Skills — Ordered  by  JAAS 
Fart  1  "Yes"  Responses  and  Part  2  Means 


2  WRITTEN  COMPREHENSION 


1  ORAL  COMPREHENSION 


3  ORAL  EXPRESSION 


SPEECH  HEARING 


32ISPEECH  CLARITY 


4  WRITTEN  EXPRESSION 


lODEDUCTIVE  REASONING 


33  VISUALIZATION 


6  PROBLEM  SENSITIVITY 


7  ORIGINALITY 


19  PERCEPTUAL  SPO  &  ACCURACY 


15  TIME  SHARING 


8  INDUCTIVE  REASONING 


5  MEMORIZATION 


11  INFORMATION  ORDERING 


14  FLUENCY  OF  IDEAS 


18  SELECTIVE  ATTENTION 


9  CATEGORY  FLEXIBILITY 


20  SPATIAL  ORIENTATION 


24  VISUAL  COLOR  DISCRIMINATION 


16  flexibility  of  closure 


NEAR  VISION 


13  NUMBER  FACILITY 


28IGENERAL  HEARING 


29  AUDITORY  ATTENTION 


12  MATHEMATICAL  REASONING 


17  SPEED  OF  CLOSURE 


WRIST  FINGER  SPEED 


46  FINGER  DEXTERITY 


47IMANUAL  DEXTERITY 


48  ARM  HAND  STEADINESS 


44IMULT1-LIMB  COORDINATION 


23  NIGHT  VISION 


25  PERIPHERAL  VISION 


301  SOUND  LOCALIZATION 


39  EXTENT  FLEXIBILITY 


38ISTAMINA 


26I0EPTH  PERCEPTION 


27IGLARE  SENSITIVITY 


34ISTATIC  STRENGTH 


35IEXPLOSIVE  STRENGTH 


36iOYNAMIC  STRENGTH 


37tTRUNK  STRENGTH 


40I0YNAMIC  FLEXIBILITY 


41IGROSS  BODY  EQUILIBRIUM 


42ISPEED  OF  LIMB  MOVEMENT 


43IGROSS  BODY  COORDINATION 


49ICONTROL  PRECISION 


SOIrATE  CONTROL 


SD  !  VAR 


0.71 

0.5 

1.6i 

2.7 

1.31 

1.7 

1.11 

1.3 

1.2! 

1.4 

1.21 
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i.oi 

1.0 

51IREACTION  TIME 

1  01 

1  1 

52ICHOICE  REACTION 

i  01 
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Figure  3.  Abilities  and  skills  profile  comparisons 
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Comparisons  of  SXills  and  Abilities  -  MOS  9  6H  and  MOS  97E 


ABILITY 

t  R 

MEAN 

«  R 

MEAN 

COMHUNICATIOM  SKILLS 

96H 

96H 

97E 

97E 

1 

ORAL  COMPREHENSION 

12 

4.7 

13 

5.8 

2 

WRITTEN  COMPREHENSION 

13 

5.3 

13 

mmam 

3 

ORAL  EXPRESSION 

13 

5.2 

13 

_ M 

i. 

WRITTEN  EXPRESSION 

10 

4.5 

13 

■ma 

31 

SPEECH  HEARING 

12 

■■BE! 

13 

5.5 

SPEECH  CLARITY 

13 

5.2 

13 

5.5 

CONCEPTUAL  SKILLS 

96H 

96H 

97E 

97E 

5 

MEMORIZATION 

13 

4.6 

12 

4.8 

6 

PROBLEM  SENSITIVITY 

13 

4.9 

13 

4.7 

7 

ORIGINALITY 

8 

4.4 

13 

9 

CATEGORY  FLEXIBILITY 

10 

4.2 

12 

r  4TZ1 

■Q 

FLUENCY  OF  IDEAS 

10 

4.4 

12 

16 

FLEXIBILITY  OF  CLOSURE 

13 

5.5 

10 

_ ^ 

18 

SELECTIVE  ATTENTION 

13 

4.6 

12 

n 

SPATIAL  ORIENTATION 

13 

5.1 

12 

4.3 

VISUALIZATION 

11 

5.2 

13 

4.9 

REASONING  SKILLS 

96H 

96H 

97E 

97E 

8 

INDUCTIVE  REASONING 

10 

5.1 

12 

5.1 

10 

DEDUCTIVE  REASONING 

13 

4.9 

13 

5.0 

■ED 

INFORMATION  ORDERING 

12 

■mQQ 

12 

4.7 

■ED 

MATHEMATICAL  REASONING 

10 

4.7 

8 

3.5 

■E 

NUMBER  FACILITY 

13 

10 

3.5 

SPEED  LOADED  SKILLS 

96H 

96H 

97E 

97E 

15 

TIME  SHARING 

13 

5.5 

13 

3.8 

17 

SPEED  OF  CLOSURE 

8 

■KE] 

7 

4.7 

PERCEPTUAL  SPO  &  ACCURACY 

13 

4.9 

13 

4.3 

KD 

REACTION  TIME 

4 

0 

KQ 

CHOICE  REACTION 

11 

4.6 

PERCEPTUAL  SKILLS-VISION 

96H 

96H 

97E 

97E 

21 

NEAR  VISION 

12 

4.8 

10 

B 

FAR  VISION 

13 

1 

4.0 

23 

NIGHT  VISION 

13 

5.1 

2 

4.0 

24 

VISUAL  COLOR  DISCRIMINATION 

13 

4.4 

11 

wmm 

25 

PERIPHERAL  VISION 

11 

4.2 

2 

_ 

26 

DEPTH  PERCEPTION 

10 

■IBS 

1 

■■EEl 

27| GLARE  SEMSITIVITY 

12 

4.3 

1 

24 
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Comparisons  of  Skills  and  Abilities  -  MOS  96H  and  MOS  97E 
(continued) 


1 

ABILITY 

#  R 

MEAN 

«  R 

MEAN 

PERCEPTUAL  SKILLS-AUOITION 

96H 

96H 

97E 

97E 

GENERAL  HEARING 

9 

4.5 

_ 2\ 

3.8 

29 

AUDITORY  ATTENTION 

8 

5.5 

8 

4.0 

30 

SOUND  LOCALIZATION 

5 

4.2 

2 

3.8 

PSYCHOMOTOR  SKILLS 

96H 

96H 

97E 

97E 

ME 

SPEED  OF  LIMB  MOVEMENT 

4 

4.0 

0 

■Q] 

MULTI-LIMB  COORDINATION 

12 

3.8 

3 

■KB 

WKE 

WRIST  FINGER  SPEED 

9 

■HSI 

7 

3.9 

K 

FINGER  DEXTERITY 

13 

_ _ L 

3.8 

K 

MANUAL  DEXTERITY 

12 

4.0 

4 

3.1 

ME 

ARM  HAND  STEADINESS 

10 

3.2 

4 

mmBB 

\ _ 49 

CONTROL  PRECISION 

13 

0 

RATE  CONTROL 

7 

4.5 

0 

GROSS  MOTOR  SKILLS 

96H 

96H 

97E 

97E 

34 

STATIC  STRENGTH 

10 

3.8 

0 

EXPLOSIVE  STRENGTH 

1 

5.0 

0 

36 

DYNAMIC  STRENGTH 

1 

4.0 

0 

37 

TRUNK  STRENGTH 

1 

5.0 

mm 

STAMINA 

2 

3.0 

1 

39 

EXTENT  FLEXIBILITY 

11 

3.8 

2 

2.5 

40 

DYNAMIC  FLEXIBILITY 

3 

4.7 

0 

41 

GROSS  BODY  ECXJI LIBRIUM 

5 

3.1 

0 

43 

GROSS  BODY  COORDINATION 

5 

3.5 

0 

25 
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Figure  4.  Skills  and  abilities:  Number  of  "yes"  responses 


27 


into  the  eight  clusters.  As  noted,  almost  all  the  raters  felt 
that  the  six  abilities  in  the  Communication  Skill  cluster  were 
important  for  the  jobs  of  both  MOSs.  A  very  different  profile 
comparison  occurs,  however,  for  Gross  Motor  Skills,  almost  all  of 
which  are  of  little  importance  for  MOS  97E.  Even  for  MOS  96H, 
only  two  abilities  (#34,  STATIC  STRENGTH;  #39,  EXTENT 
FLEXIBILITY)  were  chosen  by  a  majority  of  raters. 

fiiiTnmary  ■  The  test  data  presented  in  this  section  show  very 
clearly  that  the  JAAS  can  be  used  to  generate  abilities  and 
skills  profiles  for  two  military  intelligence  MOSs.  Very  high 
inter-rater  agreement  was  achieved  with  the  method.  Further,  the 
abilities  and  skills  profiles  appear  to  be  conceptually  and 
logically  consistent  with  the  nature  of  the  jobs  and  the  tasks 
that  must  be  performed  in  these  two  MI  MOSs.  Not  only  does  JAAS 
identify  what  abilities  are  required,  but  JAAS  also  provides  an 
estimate  of  how  much  of  the  ability  (i.e.,  skill  level)  is 
required  in  job  performance. 

Applying  JAAS  to  UAV 

Another  advantage  of  the  JAAS  technique  is  that  it  can  be 
used  to  identify  abilities  and  skill  requirements  of  systems.  As 
noted  above  in  the  introduction,  this  program  is  concerned  with  a 
number  of  new  lEW  systems  including  the  Unmanned  Aerial  Vehicle 
(UAV) .  It  was  decided  to  demonstrate  the  use  of  JAAS  by 
evaluating  two  phases  of  UAV  mission  functions: 

•  UAV  operations 

•  UAV  launch  and  recovery 

A  single  analyst,  very  familiar  with  the  current  status  of  the 
UAV  operations  and  launch  and  recovery  system,  was  used  to  apply 
JAAS  to  those  two  UAV  mission  functions. 

Figure  5  shows  the  results  of  using  JAAS  with  the  UAV.  The 
operations  phase  is  judged  to  make  very  high  demands  on 
Communication  Skills,  Reasoning  Skills,  and  Perceptual  (Vision) 
Skills.  Indeed,  for  operations  there  are  rather  high  demands  in 
all  cluster  areas  except  Gross  Motor  Skills.  The  launch  and 
recovery  phase,  on  the  other  hand,  seems  to  have  a  more  balanced 
set  of  requirements  across  seven  clusters — again  with  only  a 
slight  demand  in  the  Gross  Motor  Skills  areas.  The  highest 
demands  for  launch  and  recovery  come  in  the  Communication  Skills 
and  Perceptual  (Vision)  Skills  areas. 

A  closer  comparison  can  be  made  in  Figure  6  where  both 
operations  and  launch  and  recovery  are  shown  by  cluster  and 
individual  abilities  within  the  clusters.  On  the  whole,  as 
expected  from  Figure  5,  the  general  level  of  requirements  is 
higher  for  operations  than  for  launch  and  recovery. 
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Figure  5.  Comparison  -  UAV  OPS  vs.  OAV  L&R  by  Clusters 


Abilities 


Of  particular  interest  are  those  abilities  that  equal  or  are 
greater  than  6.0.  They  are: 

•  UAV-Operations:  WRITTEN  COMPREHENSION  (#2) 

•  UAV-Launch  and  Recovery:  WRITTEN  COMPREHENSION  (#2) 

•  UAV-Operations:  MEMORIZATION  (#5) 

•  UAV-Operations:  PROBLEM  SENSITIVITY  (#6) 

•  UAV-Operations:  FAR  VISION  (#22) 

It  is  interesting  that  probably  none  of  these  critical  abilities 
relate  directly  to  equipment  variables.  But  there  might  be  some 
clues  to  equipment  and  procedural  deficiencies  in  the  case  of  UAV 
operations  where  a  very  high  level  of  MEMORIZATION  is  required. 

This  example  illustrates  that  the  JAAS  technique  can  als'*  be 
applied  to  system  jobs  and  tasks.  Further,  while  a  much  larger 
sample  of  raters  would  have  to  be  used  to  get  good  scalar 
estimates,  the  first-cut  shown  in  Figures  5  and  6  suggests  some 
very  high  skill  level  requirements  in  some  areas  for  the  UAV. 

Comparing  UAV  and  MOS  96H 

With  the  data  now  presented  and  available,  it  is  possible  to 
illustrate  another  kind  of  profile  comparison.  Given  the  UAV 
operations  estimate,  one  can  compare  that  estimate  directly  with 
the  abilities  and  skills  profiles  derived  for  MOS  96H.  It  is 
assumed  that  MOS  97E  would  not  be  appropriate  for  this  type  of 
system  and  equipment  assignment. 

Figure  7  shows  precisely  this  type  of  comparison  using  the 
MOS  96H  data  and  the  UAV  Operations  data.  Each  cluster  may  be 
summarized  as  follows: 

1.  MOS  96H  personnel  possess  the  communication  skills 
required  for  UAV  Operations,  but  some  additional  training  may  be 
required. 

2.  MOS  96H  personnel  possess  the  conceptual  skills  required 
for  UAV  Operations. 

3.  MOS  96H  personnel  may  require  training  enhancement  in 
the  Reasoning  Skills  required  for  UAV  Operations;  a  closer  look 
at  the  individual  abilities  within  the  cluster  is  required. 

4.  MOS  96H  personnel  possess  the  speed-loaded  skills 
required  for  UAV  Operations. 

5.  MOS  96H  personnel  may  not  possess  sufficient  Perceptual 
(Vision)  Skills;  a  closer  look  at  the  individual  abilities  within 
the  cluster  is  required. 


32 


Figure  7.  Comparison  -  MOS  96H  vs.  UAV  OPS  by  Clusters 


6.  MOS  96H  personnel  possess  Perceptual  (Audition)  Skills 
that  are  not  needed  for  the  UAV  Operations. 

7.  MOS  96H  personnel  possess  the  Psychomotor  Skills 
required  for  UAV  Operations,  but  there  may  be  some  problem  with 
RATE  CONTROL. 

8.  MOS  96H  personnel  possess  Gross  Motor  Skills  that  are 
not  required  for  UAV  Operations. 

In  four  cases  (communications,  reasoning,  perceptual-vision, 
and  psychomotor  skills) ,  the  system  requirements  exceed  the 
presumed  MOS  capabilities.  The  next  step  is  to  take  a  closer 
look  into  the  individual  ability  patterns;  data  for  that 
inspection  are  shown  in  Figure  8.  The  major  problem  with  respect 
tc  Reasoning  Skills  would  appear  to  be  #13,  NUMBER  FACILITY. 

This  in  turn  suggests  an  equipment  requirement  to  manipulate 
numbers  without  aiding.  There  is  no  outstanding  specific 
deficiency  in  Perceptual  (Visual)  Skills,  but  the  very  high  level 
of  skill  requirement  for  all  seven  abilities  in  that  category  is 
notable.  In  all  four  cases,  the  system  itself  should  be  examined 
from  a  human  engineering  standpoint  to  see  if  the  requirements 
can  be  lowered  by  task  re-design. 
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Abilities  (continued) 


Conclusions 


The  work  reported  in  this  research  note  represents 
methodological  activities  in  the  selection  of  an  initial 
technique  for  identifying  MOS  capabilities  and  lEW  system 
requirements  in  terms  of  abilities  and  skills.  The  technique  is 
called  the  "Job  Abilities  Assessment  System"  (JAAS) .  To  further 
the  evolution  of  JAAS  for  routine  operational  use,  four 
activities  have  been  underway. 

First,  JAAS  has  been  subjected  to  limited  applications  to 
determine  the  adequacy  of  the  rating  method  and  rater  reliability 
with  respect  to  MI  jobs  and  tasks. 

Second,  JAAS,  modified  as  a  result  of  the  test  applications, 
must  be  applied  in  a  broader  context.  SMEs  representing  all  96 
CMF  MOSs  should  use  the  instrument  to  assess  MOS  capabilities. 
This  further  test  of  the  instrument  will  start  to  build  a  96  CMF 
MOS  ability  and  skill  inventory. 

Third,  more  analysis  data  are  needed  on  the  UAV  and  other 
new  lEW  systems  to  establish  an  inventory  of  lEW  ability  and 
skill  requirements. 

Four,  techniques  for  determining  the  compatability  between 
various  MOS  ability  and  skill  profiles  and  lEW  system 
requirements  profiles  must  be  extended.  If  these  activities 
prove  successful,  JAAS  will  be  available  for  immediate  USAICS  use 
in  MI  personnel  decision  making. 
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Appendix  A 

Job  Abilities  Assessment  System,  Part  1 
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The  Job  Abilities  Assessment  System  (JAAS)  is  a  method  for  picking  out  the 
underlying  human  abilities  that  are  required  to  perform  different  kinds  of  specific 
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In  using  Part  I  of  the  Job  Abilities  Assessment  System  (JAAS) ,  you  identified  those  abilities  ' 
that  you  felt  were  necessary  to  perform  a  specific  Job  or  task.  Now,  in  Part  2,  you  will  be  asked 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK? 
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TH  PE 


ORAL  COMPREHENSION:  The  ability  to  understand  spoken  English  words  and  sentences. 


WRITTEN  COMPREHENSION:  The  ability  to  understand  written  sentences  and  paragraphs. 


B-8 


ORAL  EXPRESSION:  The  ability  to  use  English  words  or  sentences  in  speaking  so  others 
will  understand. 
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MEMORIZATION:  The  ability  to  remember  Information,  such  as  words,  numbers,  pictures  and 
procedures.  Pieces  of  Information  can  be  remembered  by  themselves  or  with 
othe'  pieces  of  Information. 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on  the  answer  sheet. 


PROBLEM  SENSITIVITY;  The  ability  to  tell  when  something  fs  wrong  or  is  likely  to  go  wrong. 

It  includes  being  able  to  Identify  the  whole  problem  as  well  as  the 
elements  of  the  problem. 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on  the  answer 


INDUCTIVE  REASONINC.;  The  ability  to  combine  separate  pieces  of  Information,  or  specific  answers 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on  the  answer  sheet. 


CATEGORY  FLEXIBILITY:  The  ability  to  produce  many  rules  so  that  each  rule  tells  how  to  group 

a  set  of  things  in  a  different  way.  Each  different  group  must  contain 
at  least  two  things  from  the  original  set  of  things. 


10.  DEDUCTIVE  REASONING: 
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II.  INFORMATION  ORDERING:  The  ability  to  follow  correctly  a  rule  or  set  of  rules  to  arrange  things 

or  actions  In  a  certain  order.  The  rule  or  set  of  rules  used  must  be 
given.  The  things  or  actions  to  be  put  In  order  can  include  numbers, 
letters,  wofds,  pictures,  procedures,  sentences,  and  mathematical  or 
logical  operations. 


12  MATHEM<VT ICAL  REASONING:  The  ability  to  understand  and  organize  a  problem  and  then  select  a  mathematical 

method  or  formula  to  solve  the  problem.  It  encompasses  reasoning  through 
mathematical  problems  to  determine  appropriate  operations  that  can  be  performed 
to  solve  problems.  It  also  Includes  the  understanding  or  structuring  of  mathe¬ 
matical  problems.  The  actual  manipulation  of  numbers  is  not  included  in  this 
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13.  NUMBER  FACILITY:  Involves  the  degree  to  which  adding,  subtracing,  multiplying,  and  dividing 

can  be  done  quickly  and  correctly.  These  can  be  steps  in  other  operations 
like  finding  percentages  and  taking  square  roots. 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on  the  answer  sheet. 


It*.  FLUENCY  OF  IDEAS:  The  ability  to  produce  a  number  of  Ideas  about  a  given  topic. 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED 


16.  FLEXIBILITY  OF  CLOSURE:  The  ability  to  identify  or  detect  a  known  pattern  (like  a  figure,  word 

or  object)  that  is  hidden  in  other  material.  The  task  is  to  pick  out 
the  disguised  pattern  from  the  background  material. 


Interpret  the  patterns  on  the  weather  radar  to  decide 
the  weather  Is  changing 


Find  five  camoflaged  birds  In  a  picture  (l^.l^l) 


The  ability  to  concentrate  on  a  task  one  Is  doing.  This  ability  involves 
concentrating  while  performing  a  boring  task  and  not  being  distracted. 
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HOW  much  of  this  ability  is  needed  for  this  job  or  task?  Put  your  number  on  the  answer 


19.  PERCEPTUAL  SPEED  AND  ACCURACY:  Involves  the  degree  to  whibh  one  can  compare  letters,'  numbers. 
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20.  SPATIAL  ORIENTATION: 
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The  capacity  to  see  distant  environmental  surroundings. 


HOW  MUCH  OF  THIS  ABILITY  IS 


23.  NIGHT  VISION:  The  ability  to  see  under  low  light  conditions. 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on 
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HOW  MUCH  OF  THIS  ABIL 


25.  PERIPHERAL  VISION:  The  ability  to  perceive  objects  or  movement  towards  the  edges  of  the  visual  field. 
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26.  DEPTH  PERCEPTION: 


V. 

V. 
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27.  glare  SENSITIVITY:  The  ability  to  see  objects  in  the  presence  of  glare 
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HOW  MUCH  OF  THIS  ABILITY  IS  NE^EO  FOR  THIS  JOB  OR  TASK?  Put  your  number  on 


28.  GENERAL  HEARING:  The  ability  to  detect  and  to  discriminate  among  sounds  that  vary  over  broad  ranges 

of  pitch  and/or  loudness. 


29-  AUDITORY  ATTENTION:  The  ability  to  focus  on  a  single  course  of  auditory  information  in  the  presence 

of  other  distracting  and  Irrelevant  auditory  stimuli. 


HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on  the  answer  sheet. 


30.  SOUND  LOCALIZATION:  The  ability  to  Identify  the  direction 

relative  to  the  observer. 


HOW  MUCH  OF  THIS  ABILITY  IS  NEEOEO  FOR  THIS  JOB  OR  TASK?  Put  your  nunnber  on  the  answer  sheet 


31.  SPEECH  HEARING:  The  ability  to  learn  and  understand  the  speech  of  another  person. 
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32.  SPEECH  CLARITY:  The  ability  to  coAnun 1 ca te  orally  In  a  clear  fashion  understandable 

to  a  1  I s  tener . 


33.  VISUALIZATION:  The  ability  to  imagine  how  something  will  look  when  it  is  moved  around  or  when  Its 

parts  are  moved  or  rearranged.  It  requires  the  forming  of  mental  images  of  how 
patterns  or  objects  would  look  after  certain  changes,  such  as  unfolding  or  rotation 
One  has  to  predict  how  an  object,  set  of  objects,  or  pattern  will  appear  after  the 
changes  are  carried  out. 
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3<<.  STATIC  STRENGTH;  The  ability  to  use  muscle  force  In  order  to  lift,  push,  pull,  or  carry  objects. 

It  is  the  maximum  force  that  one  can  exert  for  a  brief  period  of  time. 


35.  EXPLOSIVE  STRENGTH: 
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37.  MUSCLE  STRENGTH:  Involves  the  degree  to  which  one's  stomach  and  lower  back  muscles  can  support 

part  of  the  body  repeatedly  or  continuously  over  time.  The  ability  involves 
the  degree  to  which  these  trunk  muscles  do  not  fatigue  when  they  are  put  under 
repeated  or  continuous  strain. 
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38.  STAMINA:  The  ability  of  the  lungs  and  circulatory  systems  of  the  body  to  perform  efficiently  over 
long  t  ime  periods .  This  Is  the  ability  to  exert  onesel f  physically  wi t hou t  getting  out 
of  breath. 
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39.  EXTENT  FLEXIBILITY: 
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tiO.  DYNAMIC  FLEXIBILITY: 
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^1.  CROSS  BODY  EQUILBRIUM:  The  ability  to  keep  or  regain  one's  body  balance  or  to  stay  upright  when 

in  an  unstable  position.  This  ability  includes  maintaining  one's  balance 
when  changing  direction  while  moving  or  standing  motionless. 
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GROSS  BODY  COORDINATION;  The  ability  to  coordinate  the  movement  of  the  arms,  legs,  and 

torso  together  In  activities  In  which  the  whole  body  is  in  mo 


4^.  MULTI-LIMB  COORDINATION:  The  ability  to  coordinate  movements  of  two  or  more  limbs  (for  example,  two 

arms,  two  legs,  or  one  leg  and  one  arm),  such  as  in  moving  equipment 
controls.  Two  or  more  limbs  are  in  motion  while  the  individual  is 
sitting,  standing,  or  lying  down. 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on  the  answer 


^5.  WRIST-FINGER  SPEED:  The  ability  to  make  fast,  simple  repeated  movements  of  the  fingers,  hands, 

and  wrists.  It  Involves  little,  if  any,  accuracy  or  eye-hand  coordination. 


FINGER  DEXTERITY:  The  ability  to  make  skillful,,  coordinated  movements  of  the  fingers  of  one 

or  both  hands  and  to  grasp,  place,  or  move  small  objects.  This  ability 
involves  the  degree  to  which  these  finger  movements  can  be  carried  out  quickly. 
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HOW  MUCH  OF  THIS  ABILITY  IS  NEEDED  FOR  THIS  JOB  OR  TASK?  Put  your  number  on  the  answer  sheet. 


A7.  MANUAL  DEXTERITY:  The  ability  to  make  skillful  coordinated  movements  of  one  hand,  a  hand 

together  with  its  arm,  or  two  hands  to  grasp,  place,  move,  or  assemble 
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answe 


M.  ARH-H^KD  STEADINESS:  The  ability  to  keep  the  hand  and  am  steady.  It  includes  steadiness 

while  making  an  arm  movement  as  well  as  while  holding  the  arm  and 
hand  in  one  position.  This  ability  does  not  involve  strength  or  speed 
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51.  REACTION  TIME:  The  ability  to  give  one  fast  response  to  one  signal  (sound,  light,  picture) 

when  it  appears.  This  ability  is  concerned  with  the  speed  with  which  the 
movement  can  be  started  with  the  hand,  foot,  or  other  parts  of  the  body. 
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Appendix  C 

Job  Descriptions,  MOS  97E  and  MOS  96H 
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